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(54) Embedding data in material 

(57) A method of embedding data in material com- 
prises the steps of: 

embedding data in original material to produce data 
embedded material; 

removing the watermark from the data embedded 
material to produce recovered material; 
comparing the original and recovered material to 
determine the differences and locations of differ- 
ences therebetween; and 

storing the said locations and corrections which cor- 
rect the said differences. 

A method of removing the data embedded in the 
material, comprises the steps of: 

removing the data from the material to produce re- 
covered material; 

deriving the said corrections and locations from the 
said store; and 

using the corrections to correct the recovered ma- 
terial at the said locations. 

A method of embedding data in material, preferably 
comprises the steps of: 

producing transform coefficients Ci representing a 
spatial frequency transform of the material, and 
combining the coefficients Ci with the data bits Ri 
to produce a modified coefficient Ci' where 



Ci'=Ci + ai Ri 

the method further comprising determining ai for 
each unmodified coefficient Ci as a function F{Cn}j 
of a predetermined set {Cn}j of transform coeffi- 
cients Cn which set excludes the coefficient Ci. 
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Description 

[0001] The present invention relates to embedding data in material Embodiments of the invention relate to water- 
marking material. 

5 [0002] "Material" as used herein means information material represented by information signals which includes at 
least one or more of image materia), audio material and data material. Image material is generic to still and moving 
images and includes video and other information signals representing images. 

[0003] Steganography is the embedding of data into material such as video material, audio material and data material 
in such a way that the data is imperceptible in the material. 
w [0004] Data may be embedded as a watermark in material such as video material, audio material and data material. 
A watermark may be imperceptible or perceptible in the material. 

[0005] A watermark may be used for various purposes. It is known to use watermarks for the purpose of protecting 
the material against, or trace, infringement of the intellectual property rights of the owner(s) of the material. For example 
a watermark may identify the owner of the material. 
15 [0006] Watermarks may be "robust" in that they are difficult to remove from the material. Robust watermarks are 
useful to trace the provenance of material which is processed in some way either in an attempt to remove the mark or 
to effect legitimate processing such as video editing or compression for storage and/or transmission. Watermarks may 
be "fragile" in that they are easily damaged by processing which is useful to detect attempts to remove the mark or 
process the material. 

20 [0007] Visible watermarks are useful to allow e.g. a customer to view an image e,g. over the Internet to determine 
whether they wish to buy it but without allowing the customer access to the unmarked image they would buy. The 
watermark degrades the image and the mark is preferably not removable by the customer. Visible watermarks are also 
used to determine the provenance of the material into which they are embedded. 

[0008] It is known to embed a watermark into material by applying a spatial frequency transform to the material 
25 embedding the watermark in the spatial frequency transform and applying an inverse transform to the watermarked 
material. A scaling factor is applied to the watermark. It is desirable to choose a scaling factor to improve the ability of 
the watermark to withstand unauthorised attempts to remove it; allow efficient authorised removal; reduce degradation 
of the unmarked material; and ensure that the mark is imperceptible where an imperceptible mark is desired. Those 
properties may be incompatible. Also, when material has been watermarked, it is desirable to be able to remove the 
30 mark. However, embedding a watermark in the material in such a way as to make difficult unauthorised removal may 
also have the consequence that the watermark is difficult to remove by an authorised person. 

[0009] According to a first aspect of the present invention, there is provided a method of embedding data in material, 
the method comprising the steps of: 

35 producing transform coefficients Ci representing a spatial frequency transform of the material, and 

combining the coefficients Ci with bits Ri of the data to produce modified coefficients Ci' where 

Ci*=Ci + ai Ri 

40 

the method further comprising determining ai for each unmodified coefficient Ci as a function F{Cn}j of a prede- 
termined set {Cn}j of transform coefficients Cn which set excludes the coefficient Ci wherein the coefficients are 
serially ordered and the coefficients Cn are coefficients preceding coefficient Ci. 

45 [0010] Preferably, the set {Cn}i of transform coefficients is: 

a) a set consisting of unmodified coefficients; or 

b) a set consisting of modified coefficients; or 

c) a set comprising modified and unmodified coefficients. 

50 

[0011] Thus ai is adapted to each coefficient to which it is applied, allowing it to minimise degradation of the material. 
That also allows ai to make the embedded data more robust against processing which intentionally or unintentionally 
damages the embedded data. 

[0012] The set {Cn}} of coefficients used to calculate ai associated with coefficient Ci excludes Ci. As will become 
55 apparent from the method of removing the data Ri. that allows exact recalculation of ai in the removal process and 
thus exact removal of Ri to restore the original material if no processing has occurred, and no clipping of the image in 
the spatial domain has occurred. 

[001 3] The invention allows ai to be related to the other coefficients from which it is calculated by any suitable function. 
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[0014] The transform may produce coefficients Ci in a plurality of frequency bands. The transform coefficients forming 
the set {Cn}j may be all in the same band. The transform coefficients forming the set {Cn}j maybe in a plurality of 
bands. Using a set of coefficients {Cn}j in a plurality of bands allows the data Ri to be concealed in the material using 
material properties in bands other than the band containing the data Ri. 
s [0015] In a preferred embodiment, the coefficients are serially ordered and the coefficients Cn are unmodified coef- 
ficients preceding coefficient Ci. During removal of the embedded data such ordering allows the coefficients to be used 
to calculate aji for a subsequent coefficient Cj. 
[0016] In such circumstances, the set {Cn}i may be: 

10 a) the set consisting of unmodified coefficients; or 

b) a set consisting of modified coefficients; or 

c) a set comprising modified and unmodified coefficients. 

[0017] Also, according to the first aspect of the present invention there is provided a method of removing data em- 
15 bedded in material according to the method of said one aspect, the method comprising the steps of: 

determining the values of bits Ri of the data; 

calculating, for each modified coefficient Ci\ the value of the said function F{Cn}, of the corresponding set {Cn} { of 
coefficients Cn to determine ai; and 
20 for each modified coefficient Ci', subtracting therefrom oci.Ri to restore the unmodified coefficient value Ci, wherein 

the coefficients are serially ordered and the coefficients (Cn are coefficients preceding coefficient Ci. 

[0018] In a preferred embodiment, ai is calculated from a set {Cn}i of unmodified coefficients. The method thus uses 
the restored coefficient Ci as an unmodified coefficient Cn of another set {Cn}j of unmodified coefficients for restoring 

25 another coefficient Cj'. It will be appreciated that the set {Cn}j excludes the coefficient Ci'. The set {Cn}j is of unmodified 
coefficients allowing ai to be calculated exactly from the material in which the data Ri is embedded. As a modified 
coefficient Ci' is restored to its original value it is then available to be used to calculate aj for another coefficient Cj'. 
[0019] In a preferred embodiment, the coefficients are serially ordered and the coefficients Cn are unmodified coef- 
ficients preceding coefficient Ci. During removal of the embedded data such ordering allows the coefficients to be used 

30 to calculate ai for a subsequent coefficient j 

[0020] In such circumstances, the set {Cn}i may be: 

a) the set consisting of unmodified coefficients: or 

b) a set consisting of modified coefficients; or 

35 c) a set comprising modified and unmodified coefficients. 

[0021] According to a second aspect of the invention there is provided :- 

a) A method of removing data embedded in material comprising the steps of: 

40 

receiving material in which data is embedded; 

accessing an information store storing information enabling the data to be removed; and 
removing the said data using the enabling data accessed from the store. 

45 b) A method comprising the steps of: 

embedding data in material; and 

storing in an information store information for enabling the data to be removed from the material. 
50 c) Apparatus for removing data embedded in material comprising: 

an input for receiving material in which data is embedded; 

an information store for storing information enabling the data to be removed; and 

a remover arranged to remove the said data using the enabling data accessed from the store. 

55 

d) Apparatus comprising: 

an embedderfor embedding data in material; 
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a store for storing information for enabling the data to be removed from the material; and 

a generator for generating the enabling information when the said data is embedded in the material. 

[0022] The provision of the stored enabling data allows access to enabling data which allows the embedded data to 
5 be removed. In preferred embodiments of this aspect of the invention, the enabling data is stored in a manner which 
is secure against unauthorised access to it. Methods of preventing unauthorised access to secure data are well known. 
[0023] It has also been found that, in for example video material, embedding watermarks in identical fashion in 
different images results in differing degrees of difficulty in removing the watermarks. 

[0024] According to the second aspect of the present invention, there is also provided a method comprising the steps 

10 of: 

embedding data in first material to produce second material in which data is embedded; 
removing the data from the second material to produce recovered material; 

comparing the first and recovered material to determine the differences and locations of differences therebetween; 
15 and 

storing corrections which correct the said differences and data identifying the said locations at which the differences 
occur in the first material. 



20 



35 



[0025] The second aspect also provides apparatus for embedding data in material comprising: 



an embedder for embedding data in first material to produce second material in which data is embedded; 
a remover for removing the data from the second material to produce recovered material; 

a comparator for comparing the first and recovered material to determine the differences and locations of differ- 
ences therebetween; and 

25 a store for storing data identifying the said locations and corrections which correct the said differences. 

[0026] According to the second aspect of the present invention there is also provided a method of removing data 
embedded in material, the data being embedded in the material according to the embedding method of said second 
aspect, the removing method comprising the steps of: 

30 

removing the data from the second material to produce recovered material; 

deriving the said corrections and locations from a store storing data identifying the said locations and corrections 
which correct the said differences; and 

using the corrections to correct the recovered material at the said locations. 

[0027] The second aspect also provides apparatus for removing data from material in which the data has been 
embedded by the apparatus of said second aspect, the removing apparatus comprising: 

a remover for removing the data from the second material to produce recovered material; 
40 a deriver for deriving the said corrections and locations from the said store; and 

a corrector arranged to use the stored corrections to correct the recovered material at the said locations. 

[0028] The second aspect of the invention also provides a system comprising a combination of the apparatus of the 
said second aspect (herein after a data embedder) and the apparatus of said third aspect (herein after a data remover. 
45 [0029] Ideally, the second aspects of the invention operate optimally with a lossless channel between the embedding 
apparatus and the removing apparatus. If the channel between the embedding apparatus and the removing apparatus 
is known, an emulator emulating that channel may be provided in the embedding apparatus between the embedded 
and remover of the embedding apparatus. 

[0030] For a better understanding of the present invention, reference will now be made by way of example to the 
50 accompanying drawings in which: 

Figure 1 is a schematic block diagram of a watermark embedding and removal system; 
Figure 2 is a more detailed schematic block diagram of an embedder of the system of Figure 1; 
Figures 3A and B illustrate an example of a window of coefficients and how the window relates to a coefficient Ci 
55 being modified to embed a bit of a watermark; 

Figure 4 is a flow diagram of a method of calculating strength a in accordance with an example of the invention; 
Figure 5 is a schematic block diagram of a watermark decoder; 
Figure 6 is a schematic block diagram of a watermark remover; 
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Figure 7 is a flow diagram of a method of calculating strength a in accordance with an example of the invention; 
Figure 8 is a schematic diagram of an alternative, illustrative, set of coefficients usable to calculate a; 
Figure 9 is a schematic diagram illustrating the operation of frame stores in the embedder of Figure 2 and tne 
remover of Figure 6; 

Figure 10 is a schematic block diagram of an illustrative watermark embedding and removal system in accordance 
with the invention; 

Figure 11 is a schematic block diagram of an embedder of the system of Figure 10; 
Figure 12 is a schematic block diagram of a remover of the system of Figure 10; 
Figures 13 and 14 are diagrams used herein below to describe wavelets transforms; and 
Figures 15 and 16 are diagrams of data structures of UMIOs. 

Overview 

[0031] Figure 1 illustrates a watermarking system for embedding, recovering and removing a watermark onto or from 
a video image I. The watermarking system 10 comprises a source 110 of the image 1. a strength adapter ISO. a 
watermark embedder 120. a watermark decoder 140. a watermark remover 130 and a store 150. The decoderand 
remover may be coupled to the embedder via a channel 125 which may include a video processor, and/or a store_ 
[0032] In overview the watermark embedder 120 embeds a watermark onto a video image I to form a watermanxeo 
image I'. the watermark decoder 1 40 recovers the watermark from the watermarked image I' and the watermark remover 
130 removes the watermark from the watermarked image I' to produce a restored image I". The restored .mage i may 
not be identical to the original image I. especially if the channel 125 includes a processor and/or if clipping of the image 

in the spatial domain occurs. ,...,„, ,.,,r. HaorriKoH 

[0033] The watermark embedder 120 receives, in this example, as watermark data, a UMID. UMIDs a re ™**»™ 
in the section UMIDs below. The strength adapter 180 determines the magnitude of a parameter o, referred to I here n 
as the strength of the watermark in relation to the video image I. The strength a is determined such that the w« e "narK 
may be recovered whilst minimising its perceptibility to a viewer of the watermarked image I . The watermarKed image 
I' may then be stored, and/or transmitted and/or routed for further processing, in the channel 125. 
[0034] The watermark decoder 140 generates a restored UMID 145 from the watermarked image I . The watermanx 
remover 130 generates a restored image I" from the watermarked image I' using the restored UMID. 

Watermark embedder. Figure 2. 

[0035] Figure 2 illustrates the watermark embedder 1 20 in more detail. The watermark embedder 1 20 comprises 
pseudo-random sequence generator 220. an error correction coding generator 200, a wavelet transformer 210 a in 
inverse wavelet transformer 250, a first combiner 230, a data converter 225 and a second combiner 240- The gavelet 
transformer 21 0 includes a frame store FS1 . The inverse transformer 250 includes a frame store FS2. The frame store 
FS1 stores a frame of unmodified coefficients Ci. The frame store FS2 stores a frame of modified coefficients w , 
[0036] The error correction coding generator 200 receives the UMID and outputs an error correction coded UMIU to 
the first combiner 230. The pseudo-random sequence generator 220 outputs a pseudo-random b.nary ^uence 
(PRBS) Pi. where i is the *» bit of the sequence, to the first combiner 230. The PRBS has a length Lx J 
J is the number of bits in the error correction encoded UMID. Each bit j of the error correction encoded UMID then 
modulates a section of length L of the PRBS. The first combiner 230 logically combines the error MTOC *'™ ° n ^°* 
UMID with the PRBS to produce a watermark having bits Ri. A bit Wj=0 of the error correction encoded UMID nvens 
L bits of the PRBS. A bit Wj=1 of the error correction encoded UMID does not invert the PRBS. Thus bits Wj of tne 
error correction encoded UMID are spread over L bits of the PRBS. The data converter 225 converts b.nary 1 to symbol 
♦1 and binary 0 to symbol -1 to ensure that binary 0 bits contribute to a correlation value used in the decode r <*Hgura id. 
[0037] The wavelet transformer 21 0 receives the video image I from the source 1 1 0 and outputs wavelet coettic.ents 
Ci to the second combiner 240. Wavelets are briefly discussed in the section Wavelets below. etr£in „ fh „; 

[0038] The second combiner 240 receives the watermark Ri. the wavelet coefficients Ci and watermark strengtn «. 
and outputs modified coefficients Ci" where 

Ci'= Ci + ai Ri 



[0039] The inverse wavelet transformer 250 receives the modified coefficients Ci' and outputs a spatial domain wa- 
termarked image I'. -.normrror- 
[0040] The embedder includes an ECC generator 200. The use of error correction cod.ng to produce an ror cor 
rection coded UMID is advantageous since it allows the UMID 175 to be reconstructed more read.ly should some 
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10 



15 



information be lost. This provides a degree of robustness to future processing or attacks against the wate rmark. The 
use of a pseudo-random sequence Pi to generate a spread spectrum signal for use as a watermark is advantageous 
since it allows the error correction coded UMID 205 to be spread across a large number of bits. Also, it allows the 
watermark to be more effectively hidden and reduces the visibility of the watermark. Applying the watermark to a 
wavelet transform of the image is advantageous since this reduces the perceptibility of the watermark. Furthermore, 
the strenath of the watermark is adjusted by ai to ensure that the watermark is not perceptible. 
r0041l The operation of the error correction code generator 200 will now be described. The error correction code 
aenerator 200 receives a UMID. Typically the UMID will be a binary sequence of 31 bytes. The error correction code 
Generator 200 typically outputs a 511 bit error correction coded binary sequence. Various error correction coding 
Semes are known. One approach uses BCH coding which corrects up to 31 bit errors. The error correotio n rates can 
be further improved by using knowledge of the UMID format to help correct errors. One such approach is to check for 
invalid dates times GPS locations etc. 

T00421 The watermark is preferably embedded in predetermined regions of the wavelet transformed image. Most 
preferably the upper horizontal (hH.IV)and upper vertical (1H.hV) bands are used. These bands are chosen as water- 
marks embedded in these regions are not readily perceptible. The length of the pseudo-random sequence may be 
chosen such that the watermark fills the predetermined regions in each wavelet image. The regions in which the wa- 
termark is embedded may be within a border of unmodified coefficients thereby allowing the image to the spatially 
shifted without the watermark being lost. 

20 Calculating «. Figures 3 and 4. 

[0043] In accordance with an illustrative embodiment of the invention, for each coefficient Ci. a value of a, ai is 
calculated, ai is calculated as 

25 ai = F {Cn},, 

where {Cn}, is a set of unmodified wavelet coefficients excluding Ci. which set may vary with i. that is respective values 
of ai are functions F of respective sets {Cn}, This is shown as step S8 in Figure 4. 
30 [0044] The coefficients {Cn} f of the set may be in the same wavelet band as C, or may be in different ban ds from C. 
and from each other as described below with reference to Figure 8. 

r00451 If the coefficients are in the same band as Ci, they are preferably in a window adjacent Ci. For example the 
set comprises N coefficients Ci-1 to Ci-N as shown in Figure 3 and the embodiment will be described in the following 

with reference to that. . 
35 [0046] The number N of coefficients may vary with Ci; thus for generality N is denoted as Ni. 

[0047] The function F may be any suitable function. In this illustrative embodiment F is such that 

«/ = F{Cn}/=l£c^ 

for n = i-1 to i-N for Ni*0 and ai = k for Ni = 0. 

rO0481 Fioure 3A is a map of wavelet coefficients in a frame store 300. the coefficients being in level 1 of a wavelet 
transform In a preferred embodiment, the coefficients Ci are modified only in the upper horizontal hH IV and upper 
vertical 1H hV bands to embed the watermark. However, coefficients in other bands and/or in other levels may be 

45 modified to embed a watermark. In the following only band hH. IV is considered. 

Iu045N The wavelet coefficients are stored in the frame store 300 (also denoted FS1 in Figure 2) and in th ,s example 
are stored as shown in Figure 3A grouped in the bands. The coefficients are serially ordered. For example they may 
be serially ordered by a raster scan thereof. Other scanning patterns are known. Assuming serial order.ng of the co- 
efficients in each band, for each coefficient Ci to be modified, there is defined a set {Cnfc (herein also referred to as a 

so window') of Ni coefficients excluding Ci. The set {Cn* consists of the Ni coefficients Ci-1 to Ci-Ni .preceding coefficient 
Ci on the same line, up to a maximum of for example M most recent coefficients. It will be noted that in the band hH 
IV coefficient C1 has no preceding coefficients. C2 has only one preceding coefficient, and so on. For coefficient C1 
ai is set to a predetermined value K. For subsequent coefficients the set comprises the totality of preceding coefficients. 
r00501 Thus ai is defined individually for each coefficient Ci to be modified. In the example above it is defined by the 

55 set of Ni unmodified coefficients preceding Ci. By choice of the appropriate function F ai is adapted to the , mage such 
"at image degradation can be minimised. In addition as will be discussed below .n the section Remover, this allows 
ai to be recalculated from the watermarked image coefficients, after those have been restored to their orig i nal values. 
This improves the accuracy of restoring the original image. 
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[0051] Referring to Figure 4 the illustrative procedure for calculating Ci' is as follows:- 

The calculation procedure starts at step S2. At step S4, i is initialised with value 0. At step S6, i is incremented by 1 to 
calculate ot1 at step S8 for coefficient C1\ At step S10 the value of modified coefficient CV is calculated. The procedure 
then reverts to step S6 and i is incremented. The procedure continues until all coefficients have been modified. 
5 [0052] In addition, the calculation of at may be modified in one or both of the following ways:- 

1) If ai<a TL . it is incremented to a TL , where a TL is a lower threshold; and 
if ai> a TH it is reduced to a TH , where a XH is an upper threshold. 

2) The magnitude |C n | of each coefficient is compared with a threshold C TH . 
1t > If |C n |>C TH then Cn is not included in the calculation of oci.; or 

* l c nl > C TH . then C n is clipped to (C n /|C n |)C TH 

Watermark decoder and remover Figures 5 and 6. 
15 Decoder Figure 5 

[0053] The operation of the watermark decoder 140 will now be explained in more detail with reference to Figure 5. 
The watermark decoder 140 receives the watermarked image I* and outputs the restored UM ID. The watermarkdecoder 
140 comprises a wavelet transformer 310, a reference pseudo-random sequence (PRBS) generator 320, a correlator 
20 330, a selector 340 and a error correction coding decoder 350.. The PRBS generated by the generator 320 is identical 
to that generated by the PRBS generator 220 of Figure 2 and converted by a data converter (not shown ) to values +1 
and -1 as described above. 

[0054] The wavelet transformer 310 receives the watermarked image P and, in known manner, outputs the modified 
wavelet coefficients. Ci*. The correlator 330 receives the reference pseudo-random sequence PRBS having symbols 
25 Pi of values +1 and -1 from the pseudo-random sequence generator 320, and the wavelet coefficients Ci* and outputs 
a watermark image bit correlation sequence 335. The watermarked image bit correlation sequence is determined in 
the following way. 

[0055] The modified wavelet coefficients Ci^Ci+oqR, where Rj are bits of PRBS modulated by error-correction en- 
coded bits Wj of U MID. In the example given above there are 511 bitsWj. Each bitWj modulates L bits of PRBS. There 
30 are JL bits in the modulated PRBS. 

[0056] For each error correction encoded bit Wj, the correlater 330 calculates a correlation value 

jL+L 
i=jL+\ 

where j = 0, 1 , 2... T-1, and T is the number of error correction encoded bits. In this example T=511 . A sequence 
335 of correlation values S'yis produced. 
40 [0057] The correlation sequence 335 is received by the selector 340 which outputs an uncorrected UMID 345. The 
selector 340 outputs a bit value "1" for a value of S' greater than 0 and a bit value "0" for S' less than or equal to 0. 
The error correction code decoder 350 receives the uncorrected UMID 345 and in known manner outputs the restored 
UMID 145. 

[0058] The reference PRBS Pi is synchronised with the modulated PRBS in the watermarked image. For that purpose 
*5 a synchroniser (not shown) is used. Such synchronisation is known in the art. 

Remover Figure 6. 

[0059] The watermark remover 130 receives the restored UMID 145, and the watermarked image P and outputs a 
so restored image I". The watermark remover 130 comprises a pseudo-random sequence generator 420 for generating 

a reference pseudo-random sequence Pi identical to that produced by generators 220 and 320, a spread spectrum 

signal generator 430 which produces, via a data converter 425, a restored watermark RP having bit values +1 and -1 

from the restored UMID 145 and the pseudo-random sequence Pi. The reference sequence Pi is synchronised with 

the modulated sequence in the watermarked image in known manner. 
55 [0060] The watermark remover 130 further comprises a wavelet transformer 410 which produces modified wavelet 

coefficients Ci' from the watermarked image l\ a strength estimator 460 for calculating ai and a combiner 440 which 

calculates restored wavelet coefficient values according to the equation 
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Ci * Ci" -otj. Ri*. 

[0061] The restored wavelet coefficients C are fed to an inverse wavelet transformer 450 which outputs th e restored 
5 image I". 

Calculating ai. Figure 7. 

[0062] In accordance with the illustrative embodiment of the invention, ai is calculated in the embedder as described 
10 above in the section Calculating a The estimator 460 of the remover of Figure 6 recalculates a in analogous manner 
from coefficients Ci which have been restored to their original values. 

[0063] Thus referring for example to Figure 3A and to Figures 6 and 7, the modified coefficients Ci* are stored in a 
frame store 300 indicatd as FS3 in the wavelet transformer of Figure 6 in the same way as shown in figure 3A and they 
are serially ordered in the same way as described with reference to Figure 3A. It will be recalled that coefficient Ci' has 
15 no preceding coefficients so a1 = k and C1 = C1'- kR1. For each subsequent coefficient Ci, ai is calculable from the 
set of Ni of preceding restored coefficients, all of which have been restored to their original value according to 

Ci = Ci' - otj. Ri'. 

20 

[0064] Referring to Figure 7. the calculation procedure starts at step S5. At step S7. i is initialised to 0. At step S9, 
iis incremented by 1 to calculate a1 at stepS11 for coefficient C1\ At step S1 3 the original value C1 is calculated from 
coefficients CV. The procedure then reverts to step S9 and i is incremented. The procedure continues until all coeffi- 
cients Ci' have been restored to their original values Ci. 
25 [0065] As in the embedder of Figure 2, the calculation of a may be modified in one or both of the following ways> 

1) If ai<a TL . it is incremented to a TL , where a TL is a lower threshold; and 
if ai> a TH it is reduced to ct TH , where a TH is an upper threshold. 

2) The magnitude |Cn| of each coefficient is compared with a threshold Cj- H . 
30 |f |Cn|>C TH then Cn is not included in the calculation of ai; or 

if |Cn|>C TH , then C n is clipped to (Cn/|Cn|)C TH . 

Modifications. 

35 [0066] As mentioned above the coefficients from which the value of ai is calculated may be in different bands to the 
related coefficient Ci which is to be modified or restored to its original value. Thus by way of example, referring to 
Figure 8. the set of coefficients {Cn}, used to calculate ai of band hH, IV may be in the other bands. In the example of 
Figure 8 the set {Cn}, is shown as including coefficients C1i, C2i and C3i which are at positions related to the position 
of coefficient Ci. In this way, image properties in other bands are taken into account in calculating ai to ensure that the 

40 watermark is imperceptible. 

[0067] The coefficients C1i, C2i and C3i used to modify or restore Ci, may be coefficient which are never modified. 
That can be done by modifying only coefficients in one or more bands such as hH, IV and leaving the coefficients in 
other bands unmodified. Alternatively at least some of the coefficients Cii. C2i and C3i used to modify or restore Ci 
may be modified. That can be done by storing the coefficients in a frame store 300 as shown in Figure 3 or 8 and by 

45 reading out coefficients in an order which allows the procedures of Figures 4 and 7 to be followed. 

[0068] It will be appreciated that whiJst the foregoing discussion refers for ease of explanation to only 3 coefficients 
C1i, C2i and C3i in 3 bands in one level, in practice many more coefficients may be used and the coefficients may be 
in more than three bands and in more than one level. 

50 Other transforms 

[0069] Whilst the invention has been described by way of example with reference to Wavelet transforms, it may be 
used with other transforms for example DCT. 

55 Other material 

[0070] Whilst the invention has been described by way of example with reference to material comprising video ma- 
terial ( still or moving images), it may be applied to other material, for example audio material and data material. 
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PRBS 

[0071] As described hereinabove, the PRBS has a length of L J where J is the number of bits in a UMID. Thus each 
bitWjof theUMID modulates a section of length L of the PRBS. Instead, it may have a length of L bits and be repeated 
5 for each bit j of the UMID. 

Other Watermark data 

[0072] Whilst the invention has been described byway of example with reference to UMIDs as the watermark data, 
w it may be used with other data as the watermark. 

Using modified coefficients to calculate ai 

[0073] The foregoing embodiment calculates ai using unmodified coefficients. In alternative embodiments a is cal- 
15 culated using modified coefficients or a combination of modified and unmodified coefficients. The coefficients Ci are 
serially ordered. The coefficients used to calculate at for coefficient Ci are coefficients preceding i on the serial order. 
[0074] Referring to Figures 2, 6 and 9 frames stores FS1, FS2, FS3and FS4 are provided in the wavelet transformer 
210, the inverse wavelet transformer 250, the wavelet transformer 410 and the inverse wavelet transformer 450. Frame 
stores FS1 and FS4 store unmodified coefficients. Frame stores FS2 and FS3 store modified coefficients Ci. 
20 [0075] Thus there are available both at the encoder and at the remover serially ordered sets of unmodified and 
modified coefficients. 

[0076] In the embedder of Figure 2, as coefficients Ci in store FS.1 are modified, they are stored in FS2 as coefficients 
C/\ Thus modified coefficients CP are available to calculate ai. Thus the set {Cn}/ used to calculate ai for modifying 
coefficient C/ may comprise modified coefficients C preceding Ci optionally together with unmodified coefficients C 
25 preceding Ci. 

[0077] At the remover modified coefficients Cf are stored in store FS3. As the coefficients are restored, restored 
coefficients Ci are stored in store FS4. Thus modified coefficients C are available to calculate ai optionally together 
with restored coefficients C 

[0078] As diagrammatically shown in Figure 9, sets of coefficients preceding a coefficient C/orCf are present in all 
30 four frame stores FS1, FS2, FS3 and FS4. 

Shape of sets (Cn}/ 

[0079] A set {Cn}/ may have any convenient shape. Where at is calculated only from coefficients preceding Ci, the 
35 set may consist of coefficients immediately preceding Ci. Where the coefficients are raster scanned to serially order 
them, the set may consist of coefficients on the same scanning line as Ci. Alternatively, it may consist of coefficients 
on that line and a preceding line. Other shapes are possible. 

[0080] Figure 10 illustrates a system, in this example a watermarking system, for embedding a watermark onto an 
image I and for recovering and removing it from the image. The watermarking system comprises: a source 110 of the 
40 image I;, a sub-system A for applying the watermark; a sub-system B for detecting and removing the watermark; a 
channel C linking the sub-systems A and B; and a database D. 

[0081] In overview, the subsystem A applies the watermark to the image. The watermarked image is transmitted via 
the channel C to the subsystem B where the watermark is detected and removed. It is desired to restore the original 
image in the subsystem B with no degradation. For that purpose, at the subsystem A the watermark is removed from 

45 the image by a remover 130 and the thus restored image is compared with the original image I to detect differences 
and the locations within the image of the differences. The database D stores the locations of differences and correction 
data which may be values of the original image at those locations or the differences. The subsystem B detects and 
removes the watermark to produce a substantially restored image; The removal process is the same as at the subsys- 
tem A. The locations of corrections and the corrections are read from the database and the corrections applied to th 

so restored image to correct it. In practice the system will operate on many images. Thus it is necessary to identify the 
images and the correction data associated therewith in the database D. In this example each image is identified by an 
identifier which is used to access the relevant data in the database. Preferably the identifier is a UMID. UMIDs are 
described in the section UMIDs below. Most preferably the watermark comprises the UMID. In the example of Figure 
1 , the image is transformed by a wavelet transform. Wavelet transforms are discussed in the section Wavelets below. 

55 in the example of Figure 1 wavelet coefficients are compared to determine the said differences. 
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First Example 

[00821 Referring to Figure 1 0, the source 110 produces a spatial domain image I. An embedder 120 receives a UMID 
from a generator 115 and embeds the UMID as the watermark in wavelet coefficients Ci of a wavelet transform (T) of 
5 the image according to 

Ci' = Ci + a.Ri 

w where Ci is the i m original image coefficient, Ci' is the i th modified coefficient, Ri is i lh bit of watermark data and 

a is a scaling factor. As described hereinafter Ri may be a bit of a pseudo random symbol sequence modulated by the 
UMID data Wi. 

[0083] The remover 130 removes the watermark to produce restored coefficients Ci" according to 

15 

Ci" = Ci' - a.Ri 

[0084J A comparator 125 compares the restored coefficients Ci" with the original coefficients Ci to determine any 
differences and the locations thereof. The differences and locations / are stored in the database D as correction data 

20 together with the UMID generated by generator 11 5. 

[0085] The coefficients Ci' produced by the embedder 120 are inverse transformed (T' 1 ) and applied to the channel C. 
[0086] The subsystem B receives the watermarked image from the channel C. A transformer T recreates the coef- 
ficients Ci'. The UMID is detected and removed by a detector and remover 127. The detected UMID is used to access 
the correction data in the data base and the correction data is applied to the image coefficients Ci" in a corrector 129 

25 to restore the original coefficients Ci which may be inverse transformed (T" 1 )to restore the original image I . 

[0087] In this first example, a is a fixed predetermined value. Using a fixed predetermined value of ot facilitates 
removal of the watermark. 

[0088] For the purposes of the first example, the channel C is preferably "lossless": 
30 that is it does not distort the watermarked spatial domain image. 

Second Example 

[0089] The second example is identical to the iwst except that a channel emulator 121 is provided between the 
35 embedder 120 and remover 130. The emulator applies, to the output of the embedder. a channel emulator function 
emulating the effect of channel C on the output of the embedder. 

[0090] The channel emulation 121 emulates the channel C. Thus errors introduced by the channel C can be detected 

and corrections stored in the database D. 

[0091] This is useful especially if the channel C is lossy. 

AO 

Third Example 

[0092] This modifies the first or second example in that a is not fixed. The embedder 1 20 is shown in Figure 11 and 
the remover 130. 127 is shown in Figure 12. 
45 [0093] Figure 11 is identical to Figure 2 described above except that it has a connection supplying the wavelet co- 
efficients Ci to the comparator 125 of Figure 10. Likewise. Figure 12 is identical to Figure 6 above except it has a 
connection supplying the restored coefficients to the comparator 125 of Figure 10. Thus no further description is needed 
of Figures 11 and 12. 

50 Modifications 

[0094] Whilst the aspect of the invention described with reference to Figures 10 to 12 embeds and removes water- 
marks as described with reference to Figures 1 to 9. other watermark embedding and removal techniques may be used. 

55 Wavelets 

[0095] Wavelets are well known and are described in for example " A Really Friendly Guide to Wavelets " by C 
Valens, 1999 and available at http.7/perso, wanadoo.fr/polyvalens/clemens/wavelets/wavelets.htmt. 
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[0096] Valens shows that the discrete wavelet transform can be implemented as an iterated filter bank as used in 
sub-band coding, with scaling of the image by a factor of 2 at each iteration. 

[0097] Thus referring to Figure 1 3, a spatial domain image is applied to a set of high pass HP and low pass LP filters. 
At level 1, the first stage of filtering, the image is filtered horizontally and vertically and, in each direction, scaled down 
5 by a factor of 2. In level 2, the low pass image from level 1 is filtered and scaled in the same way as in level 1 . The 
filtering and scaling may be repeated in subsequent levels 3 onwards. 

[0098] The result is shown schematically in Figure 14. Figure 10 is a representation normal in the art. At level one 
the image is spatially filtered into four bands : the lower horizontal and vertical band . IH 1 , IV n ; the upper horizontal band 
hH v IV^, the upper vertical band IH 1( hVf, and the upper horizontal and vertical band, hH n , hV v At level 2, the lower 
10 horizontal and vertical band, IH^ INA, is filtered and scaled into the lower horizontal and vertical band, IH 2 . !V 2 ; the upper 
horizontal band hH 2 , IV 2 ; the upper vertical band IH 2 , hV 2 ; and the upper horizontal and vertical band, hH 2 , hV 2 At 
level 3 (not shown in Figure 10), the lower horizontal and vertical band, IH 2 , IV 2 is further filtered and scaled. 

UMIDs 

15 

[0099] The UMID or Unique Material Identifier is described in SMPTE Journal March 2000. Referring to Figure 15 
an extended UMID is shown. It comprises a first set of 32 bytes of basic UMID and a second set of 32 bytes of signature 
metadata. 

[0100] The first set of 32 bytes is the basic UMID. The components are: 

20 

A 12-byte Universal Label to identify this as a SMPTE UMID. It defines the type of material which the UMID identifies 
and also defines the methods by which the globally unique Material and locally unique Instance numbers are 
created. 

A 1-byte length value to define the length of the remaining part of the UMID. 
25 . A 3-byte Instance number which is used to distinguish between different "instances' of material with the same 
Material number. 

A 16-byte Material number which is used to identify each clip. Each Material number is the same for related in- 
stances of the same material. 

30 [0101] The second set of 32 bytes of the signature metadata as a set of packed metadata items used to create an 
extended UMID. The extended UMID comprises the basic UMID followed immediately by signature metadata which 
comprises: 

• An 8-byte time/date code identifying the time and date of the Content Unit creation. 
35 • A 12-byte value which defines the spatial co-ordinates at the time of Content Unit creation. 
3 groups of 4-byte codes which register the country, organisation and user codes 

[0102] Each component of the basic and extended UMIDs will now be defined in turn. 

40 The 12-byte Universal Label 

[0103] The first 1 2 bytes of the U MID provide identification of the UMID by the registered string value defined in table 1 . 



Table 1: 



Specification of the UMID Universal Label 


Byte No. 


Description 


Value (hex) 


1 


Object Identifier 


06h 


2 


Label size 


OCh 


3 


Designation: ISO 


2Bh 


4 


Designation: SMPTE 


34h 


5 


Registry: Dictionaries 


01h 


6 


Registry: Metadata Dictionaries 


01h 


7 


Standard: Dictionary Number 


01h 
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Table 1: (continued) 



Byte No. 


Description 


Vatu (hex) 


8 


Version number 


01h 


9 


Class: identification and location 


01h 


10 


Sub-class: Globally Unique Identifiers 


01h 


11 


Type: UMID (Picture, Audio, Data, Group) 


01.02,03, 04h 


12 


Type: Number creation method 


XXh 



[0104] The hex values in table 1 may be changed: the values given are examples. Also the bytes 1-12 may have 
designations other than those shown byway of example in the table. Referring to the Table 1, in the example shown 
byte 4 indicates that bytes 5-12 relate to a data format agreed by SMPTE. Byte 5 indicates that bytes 6 to 1 0 relate to 
"dictionary" data. Byte 6 indicates that such data is "metadata" defined by bytes 7 to 10. Byte 7 indicates the part of 
the dictionary containing metadata defined by bytes 9 and 10. Byte 10 indicates the version of the dictionary. Byte 9 
indicates the class of data and Byte 10 indicates a particular item in the class. 

[0105] In the present embodiment bytes 1 to 10 have fixed preassigned values. Byte 11 is variable. Thus referring 
to Figure 15, and to Table 1 above, it will be noted that the bytes 1 to 10 of the label of the UMID are fixed. Therefore 
as shown in Figure 16 they may be replaced by a 1 byte 'Type' code T representing the bytes 1 to 10. The type code 
T is followed by a length code L That is followed by 2 bytes, one of which is byte 11 of Table 1 and the other of which 
is byte 12 of Table 1, an instance number (3 bytes) and a material number (16 bytes). Optionally the material number 
may be followed by the signature metadata of the extended UMID and/or other metadata. 
[0106] The UMID type (byte 11) has 4 separate values to identify each of 4 different data types as follows: 

'01 h' = UMID for Picture material 



•02h' = UMID for Audio material 



■03h' = UMID for Data material 



'04h* = UMID for Group material (i.e. a combination of related essence). 

[0107] The last (12th) byte of the 12 byte label identifies the methods by which the material and instance numbers 
are created. This byte is divided into top and bottom nibbles where the top nibble defines the method of Material number 
creation and the bottom nibble defines the method of Instance number creation. 

Length 

[0108] The Length is a 1-byte number with the value '13h' for basic UMIDs and '33h' for extended UMIDs. 
Instance Number 

[0109] The Instance number is a unique 3-byte number which is created by one of several means defined by the 
standard. It provides the link between a particular 'instance* of a clip and externally associated metadata. Without this 
instance number, all material could be linked to any instance of the material and its associated metadata. 
[0110] The creation of a new clip requires the creation of a new Material number together with a zero Instance 
number. Therefore, a non-zero Instance number indicates that the associated clip is not the source material . An Instance 
number is primarily used to identify associated metadata related to any particular instance of a clip. 

Material Number 

[0111] The 16-byte Material number is a non-zero number created by one of several means identified in the standard. 
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The number is dependent on a 6-byte registered port ID number, time and a random number generator. 
Signatur Metadata 

5 [0112] Any component from the signature metadata may be null-filled where no meaningful value can be entered. 
Any null-filled component is wholly null-filled to clearly indicate a downstream decoder that the component is not valid. 

The Time-Date Format 

10 [0113J The date-time format is 8 bytes where the first 4 bytes are a UTC (Universal Time Code) based time compo- 
nent. The time is defined either by an AES3 32-bit audio sample clock or SMPTE 12M depending on the essence type. 
[0114] The second 4 bytes define the date based on the Modified Julian Data (MJD) as defined in SMPTE 309M. 
This counts up to 999,999 days after midnight on the 17th November 1858 and allows dates to the year 4597. 

15 The Spatial Co-ordinate Format 

[0115] The spatial co-ordinate value consists of three components defined as follows: 

• Altitude: 8 decimal numbers specifying up to 99,999.999 metres. 
20 • Longitude: 8 decimal numbers specifying East/West 180.00000 degrees (5 decimal places active). 
Latitude: 8 decimal numbers specifying North/South 90.00000 degrees (5 decimal places active). 

[0116] The Altitude value is expressed as a value in metres from the centre of the earth thus allowing altitudes below 
the sea level. 

25 [0117] It should be noted that although spatial co-ordinates are static for most clips, this is not true for all cases. 
Material captured from a moving source such as a camera mounted on a vehicle may show changing spatial co-ordinate 
values. 

Country Code 

30 

[0118] The Country code is an abbreviated 4-byte alpha-numeric string according to the set defined in ISO 3166. 
Countries which are not registered can obtain a registered alpha-numeric string from the SMPTE Registration Authority. 

Organisation Code 

35 

[0119] The Organisation code is an abbreviated 4-byte alpha-numeric string registered with SMPTE. Organisation 
codes have meaning only in relation to their registered Country code so that Organisation codes can have the same 
value in different countries. 

40 User Code 

[0120] The User code is a 4-byte alpha-numeric string assigned locally by each organisation and is not globally 
registered. User codes are defined in relation to their registered Organisation and Country codes so that User codes 
may have the same value in different organisations and countries. 

45 

Claims 

1. A method of embedding data in material, the method comprising the steps of: 

50 

producing transform coefficients Ci representing a transform of the material, and 
combining the coefficients Ci with data symbols Ri to produce modified coefficients Ci' where 



Ci'=Ci + ai Ri 

55 



the method further comprising determining ai for each unmodified coefficient Ci as a function F{Cn}j of a 
predetermined set {Cn} t of transform coefficients Cn which set excludes the coefficient Ci wherein the coeffi- 
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cients are serially ordered and the coefficients Cn are coefficients preceding coefficient Ci. 

2. A method according to claim 1 wherein the coefficients of the set {Cn}, vary with i. 

3. A method according to claim 1 or 2, wherein the number Ni of coefficients in the set {Cn}i varies with i. 

4. A method according. to claim 1, 2 or 3, wherein the coefficients of the set {Cn}j have a predetermined positional 
relationship with the coefficient Ci to be modified. 

5. A method according to claim 1, 2, 3 or 4. wherein the coefficients represent a spatial frequency transform of the 
material. 

6. A method according to claim 1,2, 3 or 4, wherein the coefficients represent a wavelet transform of the material. 

7. A method according to claim 6, wherein the transform produces coefficients Ci in a plurality of bands. 

8. A method according to claim 7, wherein the transform coefficients forming the set {Cn}, are all in the same band. 

9. A method according to claim 7, wherein the transform coefficients forming the set {Cn}, are in a plurality of bands. 

10. A method according to any preceding claim wherein the said function F{Cn>, is such that 

f 0r n = j-1 to i-Nj for N/tO and ai = k for Nj = 0. 

where Ni is the number of coefficients Cn in set i. 

11. A method according to any preceding claim, wherein the said data symbols Ri are of a pseudo random symbol 
sequence having symbols Pi modulated by data Wj to be embedded. 

12. Apparatus for embedding data in material, comprising k 

a transformer for producing transform coefficients Ci representing a transform of the material, and 

a combiner for combining the coefficients Ci with data symbols Ri to produce modified coefficients Ci' where 

Ci'=Ci + ai Ri 

the apparatus further comprising 

a calculator for calculating ai for each unmodified coefficient Ci as a function F{Cn}, of a predetermined set 
{Cn}j of transform coefficients Cn which set excludes the coefficient Ci, wherein the coefficients are serially 
ordered and the coefficients Cn are coefficients preceding coefficient Ci. 

13. Apparatus according to claim 12, wherein the coefficients of the set {Cn\ vary with i. 

14. Apparatus according to claim 12, or 13, wherein the unmodified coefficients of the set {Cn},havea predetermined 
positional relationship with the coefficient Ci to be modified. 

15. Apparatus according to claim 12, 13 or 14, wherein the coefficients represent a spatial frequency transform of the 
material. 

16. Apparatus according to claim 12. 1 3, or 14. wherein the coefficients represent a wavelet transform of the material 

17. Apparatus according to claim 16, wherein the transformer produces coefficients Ci in a plurality of frequency bands. 

18. Apparatus according to claim 17, wherein the transform coefficients forming the set {Cn}j are all in the same band. 
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19. Apparatus according to claim 18, wherein the transform coefficients forming the set {Cn}j are in a plurality of bands. 

20. Apparatus according to any one of claims 12 to 19, wherein the said function F{Cn>, is such that 

for n = i-1 to /-A// for N^O and ai = k for N t = 0. 
10 where Ni is the number of coefficients Cn in set i. 

21 . A method or apparatus according to any preceding claim, wherein the data is imperceptibly embedded in the other 
material. 

15 22, A method or apparatus according to any preceding claim, wherein the set {Cn}i consists of unmodified coefficients. 

23. A method or apparatus according to any one of claims 1 to 21, wherein the set {Cn}| consists of modified coefficients 
preceding Ci where the coefficients are serially ordered. 

20 24. A method or apparatus according to anyone of claims 1 to 21, wherein the set {Cn}-, comprises at least one modified 
coefficient and at least one unmodified coefficient. 

25. A method of removing data embedded in material according to the method of any one of claims 1 to 1 2. the detecting 
method comprising: 

25 

determining the values of the data symbols Ri; 

calculating, for each modified coefficient Ci', the value of the said function F{Cn}, of the corresponding set 
{Cn}j of coefficients Cn to determine ai; and 

for each modified coefficient Ci', subtracting therefrom ai.Ri to restore the unmodified coefficient value Ci, 
30 wherein the coefficients are serially ordered and the said set {Cn}i consists of modified coefficients preceding 

coefficient Ci. 

26. A method according to claim 25, wherein the said set {Cn}i consists of restored coefficients Ci and comprising the 
further step of using a restored coefficient Ci as a coefficient of another set {Cn}j of coefficients for restoring another 

35 coefficient Cj. 

27. Apparatus according to claim 25 or 26, wherein the said set {Cn}i comprises at least one modified coefficient and 
at least one restored coefficient, the coefficients preceding Ci. 

40 28. A method according to any one of claims 25 to 27, wherein the step of determining the values of the data bits Wj 
embedded in material according to the method of claim 11. comprises correlating a reference pseudo random 
symbol sequence with the modified coefficients Ci' and decoding the correlation values to determine the data Wj 
modulating the pseudo random sequence and remodulating the reference sequence with the said data to restore Ri. 

45 29. Apparatus for removing data embedded in material according to the method of any one of claims 1 to 11, the 
apparatus comprising: 

a processor for determining the values of the symbols Ri; 

a calculator for calculating, for each modified coefficient Ci', the value of the said function F{Cn}j of the corre- 
50 sponding set {Cn}j of coefficients Cn to determine ai; and 

a subtractor which, for each modified coefficient Ci', subtracts therefrom ai.Ri to restore the unmodified coef- 
ficient value Ci, which thereby becomes available for use as an unmodified coefficient of another set {Cn}j of 
unmodified coefficients Cn for restoring another coefficient Ci\ wherein the coefficients are serially ordered 
and the said set {Cn}i consists of coefficients preceding coefficient Ci. 

55 

30. Apparatus according to claim 29, wherein the said set {Cn}i consists of restored coefficients Ci and comprising the 
further step of using a restored coefficient Ci as a coefficient of another set {Cn}i+1 of coefficients for restoring 
another coefficient Ci+1 . 



16 



EP 1 215 880 A2 



31. Apparatus according to claim 30, wherein the said set {Cn}i consists of modified coefficients preceding coefficient 

Ci. 

32. Apparatus according to claim 30, wherein the said set {Cn}i comprises at least one modified coefficient and at 
5 least one restored coefficient, the coefficients preceding Ci. 

33. Apparatus according to claim 29, 30, 31 or 32, wherein the means for determining the values of the data bits Wj 
embedded in the material according to the method of claim 12, comprises a correlator for correlating a reference 
pseudo random symbol sequence with the modified coefficients Ci', a decoder for decoding the correlations to 

10 determine the data Wj modulating the modulated sequence and a modulator for re modulating the reference se- 

quence with the said data to restore Ri. 

34. A computer program product arranged to carry out the method of anyone of claims 1 to 11 when run on a computer. 
15 35. A computer program product arranged to carry out the method of anyone of claims 25 to 30 when run on a computer. 

36. A method or apparatus according to any preceding claim, wherein the material is video material. 

37. A method or apparatus according to any one of claims 1 to 35, wherein the material is audio material. 

20 

38. A method or apparatus according to any one of claims 1 to 35, wherein the material is audio/visual material. 

39. A method of removing data embedded in material comprising the steps of: 

25 receiving material in which data is embedded; 

accessing an information store storing information enabling the data to be removed; and 
removing the said data using the enabling data accessed from the store. 

40. A method comprising the steps of: 

30 

embedding data in material; and 

storing, in an information store, information for enabling the data to be removed from the material. 

41. Apparatus for removing data embedded in material comprising: 

35 

an input for receiving material in which data is embedded; 

an information store for storing information enabling the data to be removed; and 

a remover arranged to remove the said data using the enabling data accessed from the store. 

40 42. Apparatus comprising: 

an embedder for embedding data in material; 

a store for storing information for enabling the data to be removed from the material; and 

a generator for generating the enabling information when the said data is embedded in the material. 

45 

43. A method comprising the steps of: 

embedding data in first material to produce second material in which the data is embedded; 
removing the data from the second material to produce recovered material; 
so comparing the first and recovered material to determine any differences and locations of differences therebe- 

tween; and 

storing corrections which correct the said differences and data identifying the said locations in the f irst material 
at which the differences occur, 

55 44. A method according to claim 43, further comprising applying a channel emulation to the second material, wherein 
the removing step produces recovered material from the second material to which the emulation function has been 
applied. 
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45. A method according to claim 43 or 44, wherein the storing step comprises storing, as the said corrections, the 
values of the first material which values occur at the said locations in the first material. 

A method according to claim 44 or 45, wherein the storing step comprises storing the said differences. 

A method according to claim 43, 44, 45 or 46, further comprising storing identification data which identifies the 
said material. 

48. A method according to claim 43, 44, 45, 46 or 47, wherein the said identification data comprises an identifier which 
10 identifies the second material. 

49. A method of removing data embedded in material, the data being embedded in the material according to the 
method of any one of claims 5 to 10, the removing method comprising the steps of: 

15 removing the data from the said second material to produce recovered material; 

retrieving the said corrections and locations from a store storing the said corrections which correct the said 
differences and the said data identifying the said locations in the first material at which the differences occur; 
and 

using the said retrieved corrections to correct the recovered material at the said locations identified by the 
20 identifying data. 

50. A method according to claim 49, wherein the using step comprises replacing the values of the recovered material 
at the said locations identified by the identifying data by the stored values of the first material at the said locations. 

25 51. A method according to claim 49. wherein the using step comprises correcting the values of the recovered material 
at the said locations using the said stored differences. 

52. A method according to claim 49, 50 or 51, further comprising the step of determining the identifier of the second 
material and retrieving from the said store the corrections and locations associated with the identified material. 

30 

53. Apparatus comprising: 

an embedder for embedding data in first material to produce second material in which data is embedded; 
a remover for removing the data from the second material to produce recovered material; 
35 a comparator for comparing the first and recovered material to determine the differences, and locations of 

differences, therebetween; and 

a store for storing data identifying the said locations and corrections which correct the said differences. 

54. Apparatus according to claim 35, further comprising a channel emulator between the embedder and remover. 

40 

55. Apparatus for removing data from material the removing apparatus comprising: 

a remover for removing the data from the said second material to produce recovered material; 
a deriver for deriving the said corrections and identifying data from the said store; and 
45 a corrector arranged to use the stored corrections to correct the recovered material at the said locations iden- 

tified by the identifying data. 

56. A system comprising embedding apparatus according to claim 53 or 54. and removing apparatus according to 
claim 55 linked by a channel. 

so 

57. An apparatus or method according to any one of claims 39 to 56. wherein the said material is video material. 

58. An apparatus or method according to any one of claims 39 to 56, wherein the said material is audio material. 

55 59. An apparatus or method according to any one of claims 39 to 56, wherein the said material is audio-visual material 
60. An apparatus or method according to anyone of claims 39 to 59, wherein the said data includes a UMID, 
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61. A computer program product arranged to carry out the method of any one of claims 39 to 47 and 57 to 60 when 
run on a computer. 

62. A computer program product arranged to carry out the method of any one of claims 49 to 52 and 57 to 60 when 
5 run on a computer. 
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